A trajectory formation model of articulatory movements using a multidimensional phonemic task
نویسندگان
چکیده
This paper presents a model for representing context-dependent variation of articulator movements. Our model explains the contextual e ect based on a multidimensional phonemic task and dynamic constraints of movements. The task determines the articulatory target so that invariant features of phoneme articulation are achieved. The dynamic constraints represent smoothly moving behavior of the articulators. Because the dimension of the task is smaller than that of the articulator variables, there are unconstrained degrees-of-freedom of the articulator variables. These redundant components are used to represent the contextual e ect by smoothly interpolating the adjacent tasks. The phonemic invariant feature is de ned as a linear transformation that minimizes a normalized articulatory variation. Simulation of articulatory movements is performed and the results are compared with actual movements.
منابع مشابه
Acoustic-to-articulatory inverse mapping using an HMM-based speech production model
We present a method that determines articulatory movements from speech acoustics using an HMM (Hidden Markov Model)-based speech production model. The model statistically generates speech acoustics and articulatory movements from a given phonemic string. It consists of HMMs of articulatory movements for each phoneme and an articulatory-to-acoustic mapping for each HMM state. For a given speech ...
متن کاملAcoustic-to-articulatory inversion using speech recognition and trajectory formation based on phoneme hidden Markov models
In order to recover the movements of usually hidden articulators such as tongue or velum, we have developed a data-based speech inversion method. HMMs are trained, in a multistream framework, from two synchronous streams: articulatory movements measured by EMA, and MFCC + energy from the speech signal. A speech recognition procedure based on the acoustic part of the HMMs delivers the chain of p...
متن کاملTrajectory formation of articulatory movements for a given sequence of phonemes
The method proposed here produces trajectories of articulatory movements based on a kinematic triphone model and the mimimum-jerk model. The kinematic triphone model, which is constructed from articulatory data obtained in the experiments through the use of a magnetic sensor system, is characterized by three kinematic features for a triphone and intervals between two successive phonemes in the ...
متن کاملArticulatory controllable speech modification based on statistical feature mapping with Gaussian mixture models
This paper presents a novel speech modification method capable of controlling unobservable articulatory parameters based on a statistical feature mapping technique with Gaussian Mixture Models (GMMs). In previous work [1], the GMM-based statistical feature mapping was successfully applied to acousticto-articulatory inversion mapping and articulatory-to-acoustic production mapping separately. In...
متن کاملTDA: A new trainable trajectory format
A new trainable trajectory formation system named TDA for facial animation is here proposed that dissociates parametric spaces and methods for movement planning and execution. Movement planning is achieved by HMM-based trajectory formation. This module essentially plans configurations of lip geometry (aperture, spreading and protrusion). Movement execution is performed by concatenation of multi...
متن کامل